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and medians; (2) number of students scoring above and below certain 
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skills) by individuals , glasses Jl schools, and district; and (4) 
results for subgroups of sex, ethnicity, classroom, school, grade, 
special education students, and limited ^English speakers. Scores may 
be compared to the national norm, the state, other similar districts, 
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years. Data ,of interest to the public include National Merit 
Scholarship winners, honor roll members, high school graduates 
meeting minimum competency requirements, and students who jtfill attend 
college. Results may also be used to illustrate further educational 
needs. (GDC) 
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INTRODUCTION 

Average achievement test scores have become the ultimate 
touchst one f or measur 1 ng success in pub 1 1 c schoo! s. Be it a mean 
or a median, this overpubl ici:ed statistic is a demagogue that 
tells us much less about student achievement than the public 
believes. This paper -focuses on other statistics that together 
with achievement test averages often better describe the state of 
learning in our schools. 

Our 'school system in Austin, Te^as is remarkably average compared 
to national norms. However, our individual ' schools are a study in 
contrasts. Moreover, the student populations within , each of our 
schools are quite diverse as a consequence o-f cross-town bussing 
-for desegregation. An excellent example o-f the misrepresentation 
o-f an average comes -from one o-f our elementary schools that has 
-few average students — about half are hi^h achievers from one part 
4 of the city and about half are low achievers from another part of 
the city. An average represents -few of the students in this 
school • 

Those of us who report achievement test results have begun to 
expand the statistics we provide to the public and to educational 
decision makers. Most \tpst scoring services also report 
information beyond measures of trentral tendency; however, in the 
quest to draw the bottom line for judging school effectiveness, 
the mean and median have almost exclusive reign. As we have 
compiled an array of alternatives for describing 'student outcomes 
in ways that better target strengths and weaknesses,' the 
importance of using several types of information has also become 
evi dent • 

Our urban school system, the Austin Independent School District 
(AISD) , and its community attend closely to achievement test 
scores • However , the commun lty is so di verse in its citizens that 
few v are satisfied with knowing an average score f 01^ 58,000 
students. Questions constantly are raised as to whether the 
schools are doing a fjood j ob with h l gh-achi evi ng students - When 
the progress of the academi cally able is touted by the 
Superintendent, low-income parents demand to knq)w how their 
children are faring. Recently, we have come | f ull cycle and are 
hearing questions of whether we are ignoring the average students 
and catering to special populations too much. 

In response to this situation, AISD's Office of Research and 
Evaluation (ORE) published a report that attempted to describe the 
achievement of several identifiable groups of students. In 
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addition, summary statistics were reported in our more technical 
volumes to aid in responding to further inquiries about specific 
groups of students. 

Our method was simpiV: compile a list o*f all the ways achievement 
test results have been requested and all the statistics necessar/ 
to respond to these information needs. This paper presents a 
collection of options for describing achievement test results and 
other student outcomes in ways that better aid decisibn mal ers and 
the public. The data source for this paper is the institutional 
wi So am of educators and researchers who have work ed in our Office 
of Research and Evaluation for the past five years and who have 
come to realise that means and medians on our standardized, norm- 
ref srenced ach i evement test s are mere 1 y the first step in 
describing achievement and other outcomes. 

An example of reporting that draws upon multiple instruments and 
multiple statistics to describe achievement comes from a recent 
ORE publication — 1984 at a Glance. 

£9lI§9§rbound seniors who take the Scholastic 
Aptitude Test (SAT) in AISD outperform bdth the 
state and nat 1 onal averages . The number of our 
students recognized in the National Merit Scholar- 
ship competition is three times the average number 
for a school system the size of A ISD* 

Graduates from AISD high schools are required to 
demonstrate at least ninth-grade level skills in 
both reading and mathematics on jone of several 
achievement test s v.< Aust i n * s BEST, ITBS, TAP, or 
TABS). In 1983-84, only 67. of the graduates, (other 
than untestable special education students) failed 
to do so,. Nationality, about 20*/. of the seni ors 
score bel ow this level on achi evement tests. 

N 

di9bl-§ch i_evi_ng students, those who score above the 
90th percentile on the Iowa a Tests of Basic Stills 
(ITBS), represent three to four times the 
percentage of AISD students compared to high 
achi ever s in other urban districts. 

Average students in AISD -are above national 
averages on the ITBS and TAP in grades 1-11. 
Nationally, the achievement of average students has 

over the past few years., The'aver^age student \ 
SD has not only k^pt pace with\th^Ls 
ovement, but has nloved up faster\irr most areas. 

L2y-§£i2i§2LQ9 st uden ts in AISD perform at about the 
average for low achievers around the State'. ^ On the 
statewide Texas Assessment of Basic Skills (TAEtS) , 
AISD has a -smaller percentcige of low achievers in 
reading than most other Tex as urban districts? however , 




at the elementary level, AISD has a higher percentage 
of low achievers in mathematics than most others. 

In the short time since 1?§4 at a GUnce has been published, ther. 
have been many encouraging indications that this reporting 
approach is more effective than averages alone. 



# Resul t-s are more -frequently quoted. 

Results are more o-f ten cited in connection with 
goals and action plans. 

The good news has been more convincingly 
communicated to real tor s> and the community. 

The bad news has been quiclly delegated to 
appropriate sta+f -for action. 



CASE STUDIES 

As mentioned above, we did not begin with this reporting approach: 
rather, it evolved as we encountered cases in which reporting only 
averages le-ft something to be desired. The following case studies 
are offered as examples. 



CASE STUDY #1 



A SCHOOL'S AVERAGE SCORE MAY RERRESENT 
VERY 'FEW CF ITS STUDENTS. 



In 1983-84, the median percentile -for this school at grade 1 on 
the ITBS Composite was the 41st percentile. Based on this 
statistic alone, a common and reasonable conclusion would be that 
the achievement o-f these students was below average. Yet, a 
closer look at the entire ranqe o-f achievement reveals a somewhat 
different picture. As seen below, achievement at this grade was 
distinctly bimodal. Thirty-one percent (317.) of the students 
scoreo in the top quartile (Q4) , while 307. pf the students scored 
in the bottom quartile (Ql). Only 397. of the students scored in 
the midrange of achievement — between the 25th percentile and the 
75th percentile — compared with 507. of the students at th\is grade 
in the national norming sample. In other words, Reporting the 
inedi an alone miscepresents the achievement picture at this school 
where approximately two thirds of the students scored at either 
the top or the bottom of the achievement distribution. 



YEAR: 
TEST: 



1983-84 



\ 



ITBS Composite 



RANGE 



7. SCORING IN THIS RANGE 
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75 - 99 */.ile 
1 - 25 7.1 le 



31 
3<.< 
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CASE STUDY &2: A MEDIAN SCORE MAY MAS* 

THE SCHOOL'S ACHIEVEMENT GAINS. 



Below is & compar 1 son o-f a school's med un p ere en tile at grade 5 
on the I TBS Capitalization test -for the two most recent years 
during which it was administered, 1982-83 and 1983-84- A decline 
o-f one percentile point apparently indicates that achievement on 
this test at this grade declined slightly from one year to the 
ne:tt. In -fact, this was not the case -for low achievers, as 
demon strated by the percentage o-f students scoring in the bottom 
quartile (Gl) in these two years. In 1982-83;, 387. of the students 
scored in the bottom quartile, while* in 1983-84, 6 percentage 
points -fewer o-f the students scored in that range. See below. 



YEARS: 19 82- S3 AND 1983-84 
TEST: ITBS Capitalization 

12§2z§3 1983-84 

-MEDIAN 47 Kile 46 7.iie 

\ * 
STUDENTS SCORING 

IN Ql 387. 327. 



This illustrates that with a median, the only thing that matters 
is the number o-f students who gain -from below to abov^ the 
original midpoint. As illustrated in tt^is'case, when the 
low achievers make gains, the median may not re-flect this positive 
change in ach i evemervt . Indeed, as occurred here, a median may 
even go down. Wheh this happens, the school is" not "getting 
credit" -for the students' achievement gains. 



CASE STUDY #3: A. TOTAL GROUP'S AVERAGE MAY DECLINE WHILE ALL 

SUBGROUPS 7 AVeRfc^ES RISE. 

In the result? o-f our Apr iv£ , 1981 , ITBS el ementary school testi ng , 
we encountered a case where' the total median percentile and grade- 
equivalent scores at grade 3 on the ITBS Readinq Total* dropped, 
apparently indicating a decline in achievement at that grade from 
1980 to 1981. At the same time, however , v the three ethnic 
subgroups' median percentiles and mean grade equivalent scores 
rose. What happened^ w ^ 

As seen in the figure on the next page, there was a shift in the 
school system's ethnic distribution from 1980 to 1981. In 1981, 

4 

* AISI)/0RE has a locally calculated Reading Total based upon the 
ITBS Vocabul ary and Reading Comprehensi on tests. 



tTHN I C 
GROUP 


19 8Q. 
MEAN 6.E. 




. 1981 

iijr a ii /*■ f-» 

MEAN 6.E, 


N 


MEAN G.L. N 


BLACK* 


3,19 


760 


3,30 


757 


+.11 -3 


HISPANIC 


3,33 


1078 


3,37 


1108 


+.04 +30 


ANGLO/OTHER 


M6 


2W 


4,50 


1917 


+.04 -526 


TOTAL 


. 3,95 


1281 


3,93 


3782 


-.02 ~499 



Case Study //3: Ootu|i.iri sun of changes in mean b r<j<Ju equivalent sroui.s from 1 9 80 
- tu l c J8i .... ITBS, Reading Tot.il, Cr.idc }, A1SD, 
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there was a lower overall proportion o-f Anglo students in the 
District, This higher achieving group everted less upward 
fn^luence on the 1931 District total score. Even though every 
ethrMc group's <Tjean grade equivalent score rose, the total was 
influenced less 1 by the highest achieving group- 

A second -factor entering into the picture was a change in the 
percentage o-f students taking the test in 1980 and in 1981, by 
ethnicity. An increase in the percentage o-f eligible Bl jlc\ ~>nd 
Hispanic student^ tested in 1981 over 1980 also raised the 
proportion o-f lower achieving minority students represented in the 
districtwide mean gr^de equivalent score. 

W>a th this case, the explanations o-f the test results are logical, 
and even obvious when one concentrates on the phenomena involved. 
But l -f one lool£ oniy at the overall average, the achiev^inent 
pitture is puzzling. 

* 4s. 

Our response to this anomaly, a decreaseSin total group score 
while the subgroups all increased, -focused on estimating the 
impact o-f shifts in the ethnic percentages ot the three groups in 
AISD and the total .number o-f students tested. W,e calculated on 
estimate o-f the 1981 grade-equivalent scores, based upon the 1980 
scores. Achievement was held constant, but we took into account 
the change in the percentage o-f students tested by ethnicity. 
These est l mated ^1981 grade-equivalent scores were compared to the 
actual 1981 scores to determine the expected change in achievement 
which could be attributed to shi-ft in ethnic composition and 

number o-f students tested. * 

/ 

Through the use o-f these projected scores, -AISD scores in reading 
would be expected* to be lower in 1981 in grades 1-7 and higher in 
grade 8 i-f there were? no actual change in achievement. A 
comparison o-f these projected scores with actual 1981 achievement 
indicated that: 

I 

Achievement was actually higher rather than lower in 
grades 1 , 2, and 5-7 compared to the expected 1 evel s. 
Ac hi evetaent in grades 3 and 4 declined no more than 
expected . 

Ach i evement in grade 8 i mp roved more than expect ed. 

i 

Since that ti me ? we have been reporting 1 ongi tudi nal data -for 
students who have been tested every year, thus making our y.ear-to- 
year compar i sons on the same students in addi t i on to compar l sons 
on grade levels whose make-up might shi-ft annually. 

Summary^ oj^Qase Studi.es 

The cases j List presented serve to l 1 1 us t rate" three maj or points: 

1 . The average score is i nad equate -for represent l ng the 
o-ften complex elements which make up the complete 
» achievement picture. 



2. Besides being inadequate, it 1-3 frequently misleaaino. 

3. Where ACh 1 e ✓ emen t test results are involved, caution and 
evtra attention to the phenomena involved are necessary 
to «.VvOid coming to t.ie wroflo 1 conclusion. 

! <JKat is needed, t ner ef ore , to pweseni^ the whole story is a more 
intensive list 0+ statistics f^if^wt^ch to select alternatives as 
n^ndid. The "following "menu 1 ' wa^developecl based on our vears of 
experience in responding to quest 1 ons from our community and the 
decision maters in our District, It is termed a menu to emphasize 
the point that the user may select ^trorn the list those statistics 
which best fit the user's 1 n-f ormat 1 on needs at a given time. 



MENU OF ALTERNATIVES FOR REPORTING ACHIEVEMENT 

I . Averages 
h • Means 
B. Medians 

1 1 . Studen t s scgr i_ng in certain ranges 

A. Low-achieving students in the district 

1. Below the 25th percentile 

2. Below the 30th percentile 

3. Below the 40th percentile 

B. High-achieving students in the district 

1 . Above the 75th percent 1 1 e 

2. Above the 90th percentile 
% -Z. Above the 95th percent 1 1 e 

C. Students scoring above and below the national average 
( 50th percent 1 1 e ) 

III- Skills analyses (items answered correctly in skill areas 

within each standard 1 zed test ) 

A. By individual student 



B. By groups 

I • CI assroom 

• 2. School 

/ 

J- District 

I V . Test results by subgroup (using statistics as in I, II, 

and III) 

A. By ethnacity 

B. By se;i 

C. By classroom 

D. By school 

E. By grade » 

F. For speciaf education students 

G. For 1 lmi ted-Engl 1 sh-prof ici ent (LEP) students 

r 

V . Qomgar i_sgn with reference groups (using statistics as in I, 

1 1 « and III, and groups 
as in IV) 

A. With a national nor mi ng samp le 

B. With the state 

C. With other similar districts 

D. Wi th surround l ng suburban districts 

E. With the district in previous years 



Standardized norm-referenced or criterion-referenced test scores 
do not represent the -full range o-f options available -for 
describing student academic progress or -for identifying needs 
within a school or school system. 



V I . S i_QQs of Success 

A. Col 1 ege-bound seni ors 

B. High school graduates attending college 



/ 



C. National Merit Scholarship winners 

1. Semifinal i9ts 

2. Finalists k 

3 . Schol arship recipients 

D. Students scoring at or above grade level 

E. Students on the honor roll 

F. Students not -Failing any courses 

G. High school graduates meeting minimum competency 
r equi rements 

t H. Students promoted 

I. Students meeting or exceeding their predicted achievement 
level^ J 

J- Students gaining one or more years in a year, 

K. Gi-fted and talented students \ 

\ 

k L- Stttdents receiving awards \ 

M. Average daily attendance rates 

VII. Nggds assessment ) 
1 A. Special education students 

B.* 'Students in bilingual education 
C Students in compensatory ^educat i>on programs 

D. High school dropouts 

E. Students -failing at least one course • 

C * 

F. Students eligible for -free or reduced-price meals 

4 

G. Students disciplined . ; 
^H. Limited-English-pro-ficierrt (LEP) students 

I . Minority students 
J. Students below grade level 

K. Student not meeting minimum competency requirements 

ERIC n 



l. • Students net meeting tneir area i rt ec ac k .e.e - 



Students not making a year' s 



3 g a : r 



N. Students not promoted 

EXAMPLE OF ACHIEVEMENT REPORTED FOR A SCHOOL 

Attachment 1 contains sampies of some of tne achieven.e- 
provides to carnpus'es. A page is included fron eac^ _ r 

ft long 1 1 ud mal present at i on of a 1 ; m i t ec se* . - : 
character i st ics, 



Median scores for tne school, resorted l:>n~;t t c . * . . - 
ethnic group, 

Percentages of students scoring m selected percert . 

Current ach levernent and other oerfcrwarici*' da*: * s " e 
scnool, and 

ft comparison of the school's actual and predicted ac^gvg >e- : 
(accompanied by a description of the report). 



CONCLUSION 

Cur reoorting options are limited more by time than by lac- : * creativit 
or shortages of other resources. Our hope is that tnis list c f ootentia 
statistics can serve as a quick reference for us and others as we decide 
which orte or ones of these we will report whenever student arcgress is 
Deing described. 
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I Atcacnmenc I 

SCHOOL CHARACTERISTICS (Pa8e 1 of 7) 



(Grades K-3) 



1980-81 

I- ^ 



1981-82 

K 1-3 



1982-83 

1-7 



1983-84 



1984-85 



25.5 



38 



219 



48 



95 



25.0 



175 



159 I 6o 



Q5 



.0 



66 



6 
94 
0 



10 
53 



SCE Cour»se- 
lor 



12 
88 
0 



25.0 



100 



•A 



i 



29 



19 
81 
0 



20.0 



:o.s 



71 



33 



18 
59 
23 



• i. i. £ — e A. 

. SCE Counse- 
lor 

. Early 
Childhood 



10 
37 
3 



Chapcer 1 
Chapcer 2 

cl". 

SCE Counse- 
lor 
Eariy 
Childhood 



95 



63 



16 
53 
31 



8 



.Chaucer 1 
.Chapcer 2CL 
. SCE 

Counselor 
. Early 
Childhood 



1 



. rroi ecc PASS 
BRIEF DEFINITION 

-tu~oer jtjcento or. :ne :urrant roll of -.he scnooi (including 
A - : s: e;:a. era.:,: j: i jn sc^uencs* ave rageu for cne one i re year. 

•vTTENDA^CI: The cercer.tacs :f scucencs on the currenc roll who actually are ^ 
.r.w^uo^r.^ regular and specia- education students) averaged cor che entire year^ 

LA >.ER RATIO: The average nur.ee r of scudencs (regular and resource) per 
classroom teacher .n the srhgei. s 

i"l>\l STUDENTS: The percent : : scuaencs at che school who qualify for rree 
luncn, based uocn cne thirc six-weeks rnemoership . 



D [£TRI3iTTI0M : The percent o: enrolled students on October 1st who are 



-.sDanic \ H ^ , 3 lack. (3), ana Anglo, Otner (A) 



MAJOR SPECIAL PROGRAMS: Programs bringing additional resources to a number of 
^cnools in the District, having a direct effect on achievement, and operating in this 
i or. oo L . 



9 

ERJC 



n. 



13 



BEST 
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ACHIEVEMCNT PROF HE /MEDIANS 
IOWA TESTS OF BASIC SKILLS 

SCHOOL : MR 

GRADE: 03 
DATE OF REPORT: JUNE. 1904 


ALL STUDENTS TESTED 
IN THIS SCHOOl 
GR 3 GR 3/ GR 3 GR 
79-80 BO-M B1-B2 B2 - 


3 

03 


GR 


3 

04 


STUDENTS TESTED 
THE LAST 2 YEARS 
AND IN THIS SCHOOL 
THE LAST YEAR 
GR 2 GR 3 
82-B3 B3-04 . 


STUDENTS TESTED 
THE LAST 3 YEARS 
AND IN THIS SCHDOL 
THE LAST 2 YEARS 
GR. 1 GR 2 GR.3 
01-62 02-63 03-04 














HATM . T°TH . 

ALL STUDENTS 

NUMBER 


GE 
XUE 
TESTED 


3 6B 
46 
69 


3 . 


74 

4B 
73 


4 


OB 
59 
43 


4 IB 

^63 


4. 


00 
50 
51 




• 2 


63 
42 
41 


3 


70 
47 
4 1 


1 B3 
5 1 
25 


2 73 
46 
25 


4 . 


30 
6B 
25 














bl v ack 

\ NUMBER 


GE 
%IL£ 
TESTED 


3.7B 

A Q 

62 


3 . 


2fr 
29 
36 


3 


00 
20 
21 


f 

3' 


6B 
46 
27 


3 


50 
39 
22 




2 


30 
27 
22 


3 


50 
39 
22 


1 . B3* 
40* 
13 


2 63* 
42* 
13 


3 


BO* 
51 ♦ 
13 














HISPANIC 

NUMBER 


GE 
%ILE 
TESTED 


3 .30*' 

J 1 * 

s 






3 


75* 
47 ♦ 
4 






3 


io* 

27* 
B 




2 


45* 
33 ♦ 
6 


3 


00* 
19* 
6 


1 60* 
3D • 
4 


2 40* 
3 t * 
4 


3 . 


00* 
21* 
4 














GE 

ANGLO/OTHER ^ XILE 
NUMBER TESTED 




4 


51 
7 5 
35 


4 


75* 
01* 
IB 


5 


£0 ♦ 
90* 
15 


4 


73 
BO 
21 





3 


60* 
B 1 * 

1.1 


4 


B1 * 
02 * 
13 


3 OB* 
05* 
B 


4 35* 
95* 
B 


5 


15* 
90* 
B 

" r— 
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HATH COftCEPT.S 
ALL STUDENTS 

NUMBER 


i 

GE 
XILE 
TESTED 


3 .55 
41 
69 


3 


7B 
49 

73 


4 


10 
59 
43 


4 


46 
OB 
45 


3 


B5 
51 
51 




2 


54 
39 
41 


3 


63 
44 
41 


1 . 64 
42 
25 


2 6B 
44 

25 


3 


9B 
55 
25 














BL ACK 

NUMBER 


GE 
XI L E 
TESTED 


3 60 

A 1 

62 


3 


00 

A J 

3G 


2 


DO 
2 2 
21 


3 


4 1 
3d 
27 


3 


15 

27 
22 




2 


4b 
36 
22 


3 


15 

27 
22 


1 . 56* 
3B* 
13 


2 50* 
3B* 
13 


3 


63* 
45* 
13 














M 

H I SPAN I C 

NUMBER 


GE 
X I L E 
TESTED 


2 BO* 
5 






4 


30* 
63 * 
4 






3 


30* 
32* 
B 




2 


20* 
26 * 
6 


3 


OB* 
26* 
6 


1 30* 2 35* 
2i«*~^32* 
4 4 


2 


B5* 
19* 
4 












* 


ANGLO/OTHER 

NUMBER 


GE 
X I L E 
TESTED 




4 


63 
35 


5 


19* 
B5 * 
IB 


5 


40 
69 
15 


> 4 


74 

75 
2 1 




3 


73* 
79 * 
13 


5 


06* 
B3 * 
13 


3 10* 
90* 
B 


4 75* 
94* 
0 


5 


25* 
B6* 
B 














HATH PROBLEMS 
ALL STUDENTS 

NUMBER 


GE 
XILE 
TESTED 


3 B5 
51 
69 


3 


90 
55 
73 


4 


00 
56 
43 


4 


10 
59 
45 


3 


9B 
55 
51 




2 


63 
43 
4 1 


3 


BO 
49 
41 


2 07 
BO 
25 


3 01 
57 
25 


4 


59* 
25 










f 




BL ACK 

NUMBER 


GE 
X I LE 
TESTED 


3 55- 

62 




57 

A 1 
^ A 

36 


2 


75 
20 
2 1 


3 


BO 
43 

27 


3 


40 
37 
22 




2 


51 
40 
22 




40 

37 
22 


1 . 93* 
55* 
13 


2 7B**3 
4B* * 
13 


76* 
4B* 
13 














HISPANIC 

NUMBER 


GE 
XUE 
TESTED 


3.40* 

J / * 

5 






3 


60* 
43 * 
4 






" 2 


.75* 
22* 
B 




2 


15* 
2B * 
6 


2 


35* 
14* 

6 


1 . 65* 
44* 
4 


2 20* 
32* 
4 


2. 75* 

f A 














ANGLO/OTHER 

NUMBER 


GE 
XILE 
TESTED 




4 


. 4B 
70 
35 


4 


50* 
7 1 ♦ 

IB 1 

-V 


4 


9 1 
B2 
15 


• 4 


76 
7B 
2 1 




3 


75* 
79 ♦ 
13 


4 


90* 
B1 ♦ 
13 


'3. 00* 
07* 
0 


4. 15* 
90* 
B 


to* 






• 




9 




HATH CQMEiimiQH 
ALL STUDENTS 

NUMBER 


GE 
XILE 
TESTED 


3 B 1 
50 
B9 


3 


B7 
4 1 

73 


3 


. 7B 
4B 
•43 


4 


1 3 
67 
45 


4 


31 
75 
51 




2 


73 
45 
41 


4 16 


2. 10 
76 
2 5' 


2 80 
50 
25 


4 


. 55 
B3 
25 




\ 

O ' 


* 




o> 

OQ 
ft) 




BLACK 

/ NUMBER 


GE 
XILE 
TESTED 


3*95 
' 59 
B2 


3 


30 
22 
36 


3 


.04 
14 
2 1 


3 


BO 
50 
27 


4 


.05 
64 

2a 




2 


35 
20 
22 


4 


. 05 J 
64^ 
22 


1 . 93* 
64* 
13 


2 70* 
44* 
13 


4 


. 35* 
76* 
13 




** 




fs) 
O 




HISPANIC 

* NUMBER 


X^LE 
TESTED 


3 43* 
2B« 

5 






3 


70* 
47* 
4 






3 


, 70* 
43* 
B . 




2 


. 40* 
26* 
» B 


3 


. 65* 
40* 
6 

B3.* 

B9* 

13 


1 . 95* 
65* 
4 


2.15* 
IB* 
* 4 


3 


. 45* 
31* 
4 
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ANGA.O/OTHER ' 
/> NUMBER 


GE 
XHE 
TESTED 




4 


. 13 
67 
35 


4 


45* 
BO* 
IB 


4 


.BO 
BB 
15 


• 4 


.73 
57 
21 




3 


.40* 
B3» 
13 


4 


2. 50* 
9Q* 
B 


4 . 00* 
95* 
B 


3 


. 25* 
96* 
B 




/ 
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• A MEDIAN CAICULATEO 


FOR A b 


MAIL NUHfltfl Of STUDENT 
i 


S S 


10UID NOT BE 
• 


CONSIDERED .AS A 


RELIABLE MEASURE OF A 


GROUP'S 


ACHIEVEMENT. 


1* 



AUSTIN INDEPENDENT SCHOOL DISTRICT 



PROFILE OF HIGH AND LOW ACHIEVERS 



school: wmm* 

GRADE: 03 
DATE OF REPORT: JUNE. 


1904 


ALL STUDENTS ICS JED 
IN THIS SCHOOL 
GR 3 GR 3 GR 3 GR 3 
79-80 80-81 01 -82 82 - 0 3 


GR 3 


STUDCNIS TESTED 
ThC LAST 2 YEARS 
AND IN THIS SCHOOL 
HIE LA$I YEAR 
GR '2 GR 3 
02-03 83-84 


STUDENTS TESTED 
THE LAST 3 YEARS 
ANO IN THIS SCHOOL 
THE LAST 2 YEARS 
GR 1 GR 2 GR.3 
81-82 82-83 03-04 


MMH-TPTAL 




\ 




















% OF STUDENTS 
SCORING IN 
THESE XILE 
RANGES 


90*99 
75-99 
1-25 
1- 10 


7X 
20X 
25X 

7X 


MX 

30X 
2GX 
IOX 


12X 
•12X 
3 OX 
I9X 


24X 
4 OX 
20X 
4X 


MX 
37X 
22# 
I2X 




I2X 
24X 
34X 
7% 


15X 
34X 
24X 
I5X 


36X 

ax 
ox 


20X 

1 R t 
J D At 

24X 
4X 


2 OX 
44X 
16X 
12X 


X AT LEAST THIS 

FAR FROM GRADE LEVEL 


t 1 G£ 


16X 
1 4 X 


I9X 
I6X 


26X 
23X 


jbx 

9X 


25X 
16X 




I5X 
7X 


22X 
2 OX 


36X 

ox 


20X 
4X 


32X 
16X 


NUMBER 


TESTED 


69 


73 


43 


45 


51 




4 1 


41 


25 


25 


25 


MATH CQflSilEIS 


























X OF STUDENTS 
^CORING IN 

t lie C C V II C 

lilt ob XILb 
RANGES 


80 99 
75 99 

1 - 10 


tit 
I7X 
22X 
IOX 


MX 

27X 
29X 
IOX 


MX 
A1X ^ 
28X 

ax 


27% 
<1 OX 
20X 
9X 


4X 
27X 
22X 
16X 




I2X 
24X 
29 X 
I7X 


2X 
27X 
24X 
20X 


20X 
3^3 X 
24X 
4X 


2 OX 
36X 
20X 
12X 


4X 

36X 
I6X 
I2X 


X AT LEAST THIS 

FAR FROM GRADE UVCL 


* 1 GE 
- 1 GE 


17X 
j 7X 


27X 
1 9X 


42X 
I9X 


4 OX 

i ax 


27X 
20X 




15X 
1 V X 


27X 
24X 


36X 
4X 


24X 
1 2X 


30X 
1 6X 


NUMUER 


TESTED 


69 


7 3 


43 


45 


51 




4 1 


4 1 


25 


25 


25 




























X OF STUDENTS 
SCORING IN 

IMC C C V, TIC 

RANGES 


90-99 
75-99 

1 * J. 3 

t - 10 


4X 
12X 
23X 

7X 


IOX 
23X 
22X 
IOX 


I2X 
21X 
33X 
19X 


16X 
33X 
13X 
4X 


MX 
27X 

1QX 




IOX 
27X 
37X 
12X 


l?X 
24X 
32X 
22X 


20X 

4X 
OX 


I6X 
32X 

ax 


16X 
20X 
. 20X 
f6X 


X AT LEAST THIS 

FAR FROM GRAOE LEVEL 


i 1 GE 
- 1 


J 2X 


23X 
1 OX 


21X 
28X 


33X 
9X 


27X 
25X 




24X 
17X 


24X 
29X 


36X 
OX 


36X 
12X 


20X 
16X 


NUMUER 


tes rno 


69 


73 


43 


45 


51 




4 1 


4 1 


25 


25 


25 


MAIM. CQ.NPM T AJ.IQN 


























X OF STUDENTS 
SCORING IN 
THESE XILE 
RANGES 


90 99 
75-99 

1 - 10 


6% 
29X 
29X 
I2X 


12X 
32X 
37X 
MX 


5X 
37X 
35X 
19X 


I6X 
47X 
22X 
16X 


22X 
53X 
20X 
6X 




1 5X 
24X 
37X 
I7X 


2 OX 
49X 
20X 
7X 


20X 
52X 
4X 
OX 


20X 
20X 
24X 
12X 


2QX 
64X 
16X 
4X 


% AT LEAST THIS 

FAR FROM GRADE LEVEL 


, ♦ 1 GE 
• f GE 


I4X 
1 OX 


Hit 
1 IX 


5X 
MX 


22X 
16X 


29X 
2X 




I5X 
15X 


2 9X 
2X 


I2X 
OX 


20X 
12X 


4 OX 
OX 


NUMUER 


TES IEO 


69 


» 73 


43 


45 


51 




4 1 


41 


25 


25 


25 
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AUSTIN !K»i>FPfr;;>r'.? \.fiiH n l STK I f 1 
ACHIfcVFMf NT/l'H'f NH' if/U'fiTIXl "Mi: 40* 

t I 3 'M 



» Ul! SCfKiOL A ^«> 



4.* 



STiioifilS Ai IS AfU)V£ GKA^ HVFL, C ,.'.,HG 1 
SH'.) r l,r, GAH.IMO (N c 0^ " M i 1 V v ^ IN 1 4 

students tit ing/fxccjiiki m m »»i -oir r in 

MAT M 

<. mnf M . iO T UhJrniVrS, SPh IN*, lvH^ 

MAT rt 



<t7.4 

^3.8 

47.1 
.0 

80.0 

82 



*>2. 5 

48.7 

80. / 
fin. 8 



4# 



AU ' P PiO'P^T^M StHC'L Ml Ml ICT iANAM T 



{Jf of, 



unV'lNGMW jTU'^MS, OCTOBER P'H4 
AVn»Ar,, riAltY ► 7TIN01NCF Ul 1983-A4 
STU'fNTS Nli I 0\ M \ i'l lht(> IN 1983-84 
Ml' F^r/HMff'. I- ICP j^AI *983-84 
&TU0E H f ».: § T it.*. wCTO'lFD 1084 



STlinCN f 



S* 



1 Pi A 



STUlU MS I'll ' 11 r ') 



r.ni y ^ r r i a l rfsur J * r> 

« VU>f MSATOH Y Eh. I^MCKft* IN 
;TU')f/.T r . MIT l-'.-'ijIUNf-D IN 
K>f THf r»nil F VM.iiL VEAf: IN 

PUP I t '> Pr* T f. A0Ht*< IN 
STiJMf-rjrs I'KNMUTfO, 



I 9f* 

198*4-8- 

1CR1-A* 
1983- ^ 



■>2 
2 A 



15 

■4 3 
j 3 

^ 7 

3 3 
44 



SYSTbM 



2b. 5 
9A.3 
98.3 
31 .0 
98, 1 
<>2.7 
i>5.9 
82. S 
81.5 
23.8 
96.5 



AISO 
EL 

49.3 
94.0 
97.7 
55*0 
93. S 
90, A 

75.2 
84.1 
80.7 
23.6 
96.6 



0 
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AUSTIN INDEPENDENT 'SCHGQL OISTRICT 
OFFICE QF RESEARCH ANO EVALUATION 



REPC3T QN SCHOOL EFFECTIVENESS ( ROSE) FOR 1993-34 



SCHOOL: Wft 

************** ***m**********^tt***************^ 



* 

* GRADE 



* 
* 
* 
* 

* 

* 

* 

* 



PERFORMANCE IN*.. 



READ IN£ 



BELOW PREDICATED GAIN 
( -0.27, U= 54 ) 

ACHIEVED PREDICTED GAIN 
( -O.L7, N= 59) 

EXCEEDEQ PREDICTED GAIN 
t *0.36, N= 50) 

BELOW PREDICTED GAIN? 
{ N= 40) 



MATH 



BELOW PREDICTED GAIN 
( -0*23 r N» 58) 

ACHIEVED PREDICTED GAIN 
( N= 58) 

EXCEEDED PREDICTED GAIN 
( KU20» N=* 50) 

ACHIEVED PREDICTED GAIN 
( +0.L3 f Na 40) 



* 
* 
■ * 
* 
* 

* 

* 

* 

* 



*********** ****^**********^******* ************&**** 



4 ********************************** ********* 



* 


SCHCOL CHARACTERISTIC 


VALUE 


* 


a— 

* 






* 


* 


SEX 




* 


* 


MALE 


472 


* 


* 


FEMALES 


532 


* 
* 


* 


ETHNI&ITY 




* 




BLACK 


65* 


* 




HISPANIC 


f42 


* 


* 


OTHER 


212 


* 
* 


m 

*• 


WAS SCHOOL IMPACTEC 




* 




BY DESEGREGATION? 


YES 


* 
* 


* 
* 


PERCENT REASSIGNED STUDENTS 


L72 


* 


* 


PERCENT TRANSFER STUDENTS 


242 


* 
* 


* 


PERCENT LOW-INCOME STUCENTS 


712 


* 


* 








* 


AVERAGE PUPIL/TEACHER RATIO 


24-TQ-L 


* 



******************************************** 
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AUSTIN INDEPENDENT SCHOOL DISTRICT 
Office of Research and Evaluation 



THE ROSE — THE REPORT ON SCHOOL EFFECTIVENESS 
1983-84 

blhaut it> ROSE ? 

t < \ 

ROSE, the Report on School Effectiveness, provides information about AISD 
schools that is more than just descriptive. It is the result of a series of 
statistical analyses which answer the question, "How do the achievement gains 
of a school's students compare with those of oth/r AISD students of the same 
previous achievement levels and background characteristics?' 1 Regression 
analysis is used to produce predicted achievement levels* in reading and math 
for each student based on the following characteristics: 

• Previous achievement level, 

• Sex, 

• Ethnicity, 

• Family income (whether or not the student or a sibling 
received a free or reduced-price lunch) , 

• Whether or not the student's school wfcs impacted by 
desegregation, * 

m Whether or not the student was reassigned by the desegr- 
egation plan, 

p Whether or not the student was a transfer student, and 

• The average pupil/ teacher ratio for the student's grade 
at his/her school (elementary only). 

The predicted scores are then compared with the students' actual scores. On 
the elementary and junior high printouts, the numbers in parentheses^ give the 
average difference between the predicted and actual scores in grade^ equiva- 
lents. For example, a value of +.10 woulctsnean that the students at that 
.grade scored one month higher on the averaged than ^similar students distfict- 
wide. The verbal descriptors, "Exceeded Predicted Gain," "Achieved Predicted 
Gain," and "Below Predicted Gain" are assigned according to the statistical 
significance of $he results. If the obtained average is far enough above or 
below the expected value of zero so that it would have occurred only 5% of 
the time or less by chance, then the "Exceeded" or "Below" label i»- assigned. 

In producing the high school printouts, the comparison of actual and predicted 
scores is used to classify students as being either above or below their ex- 
pected level of achievement. Again a statistical tes f' is jused to assign the 
verbal descriptors usijng the same decision ruie, p£.05. 

mat 16 tki puxpoAt o£ ROSE? 

The purpose of ROSE is to improve student achievement in reading &nd math 
through the identification of groups of students who are experiencing excep- 
tional auccesb or failure. JThe identification of these students creates an 
opportunity for improvemernr in the pverall program if practices or conditions 
associated with the success or failure of thede students can be identified. 
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If a school has students who are scoring above the predicted levels in read- 
ing and math, an examination of the practices of their teachers may reveal 
information which will be useful in improving performance for students in 
other groups or subject areas. Cases where the students are scoring below 
the predicted level also require close attention so that practices or condi- 
tions which, are retarding student growth can be identified and altered. 

Some CcuutwnA l * 

In using ROSE, .keep the following points in mind: 

a. ROSE has its greatest value when the results do not entirely match 
your informal assessment; i.e., when it is providing you with new 
information. If the results are the complete opposite of your expe- 
rience, however, then the analyses should be viewed ^with caution. 

b. Test results have been considered only for reading and math. Exemplary 
or poor performance in other areas has not been examined. 

c. ROSE attempts to adjust for as many factors outside the school's control 
as possible. When above- or below-average performance is found, addi- 
tional factors outside the school's control may still be operating. 
Knowledge of the situation at the school is important to a full under- 
standing of the ^report. 

\ 

d. ROSE should be used constructively. The emphasis should be on initiating 
and reinforcing godd practices and identifying problems. Remember, the 
purpose is to improve the education of our students . 

e. Given that ROSE controls for certain background characteristics, some 
schools with high concentrations of low-income, low-achieving students 
will be found to exceed predicted achievement at some grades, eveii 
though their average achievement level is low. It is a strength of 
ROSE that it recognizes the effectiveness of the teachers of these stu- 
dents; however, nothing in the ROSE report should be taken as an indica- 
tion that the District is satisfied with the achievement of our low- 
achieving students. Indeed, it is a priority goal of the District that 
low student achievement be improved at all grade levels. We expect over 
time that the effect of certain factors now explaining low achievement 
will have less effect on predicted! achievement. ROSE may contribute to 
the success of that goal by reinforcing the efforts of effective teachers 
and by highlighting effective practices for others to follow. 

f . The statistical significance of the results are influenced by the number 
* of students tested; i.e., any given value is more likely to represent a 

real difference from the expected value if it is obtained from 100 stu- 
dents rather than 50. Therefore, in some cases elementary and junior 
high results that are significant may appear to be less extreme than 
other results th^t are nonsignificant if the sizes of the groups differ 
greatly. 1 

School ChaAActoAAAtieA Tn^onmcutijOYi 

The values for the school characteristics listed on the ROSE may differ from 
those listed in individual school achievement profiles or elsewhere. The 
ROSE values are based op the population used in doing the analyses and there- 
fore may not exactly reflect the total school population. 

( 17. 
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' Jl jine SeCectioti d Jitter natives 
Jbr f(eportinj Jlcnievement 
and Other StudentP&qtcomcS' 



The Ave/iage Ac/ttevemew£ Tc6t Scoie: 
A Qemgoguo. Statistic < 

G£(/nn Lujon, P/uP, 
flaotd Welkin* on 

Handout accompanying a papoA ptaaen- 
tation at the Knmat Meetcwg oh thz 
Am&Ucan Educational ReaeaAch /Ui occ- 
asion, Cftxfiago, UUino^U, Ma/tch, 19&5 

Publication HumboA 84.42 
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Traditional fare 



f 1. Ave/uige Achievement Tut Sc.on.t6 

♦ Mean* 
£ Medians 



^ Entrees 

2. Students 5co/Luig in CoAtain Range* - 

♦ Low- achieving Atud&vtb in the. dibt/Uct 

♦ Be£w> #te 25#i .peACQSitile. 

♦ Below ;tfie pe/icentc£e 
* ♦ B&lam the 40th peAcektite. 

♦ Hijgk-athizving Atudejitb iti the. dLL&t/Uct t 

♦ Above, the. 75th peAcesitite. 
' * Above t/ie 90#i pe/icen£c£e 

♦ Above t/ie 95#i percentile 

♦ Student* <s coding above and 6e£oio t/ie 

national aveAage. [50th peAczntite.) t f 

I 

3. SkAJUU AnalybU - _y 

♦ By individual student 

♦ By Qtiou.pt> * ! 

t CluAAoom \ 

♦ School * 
v ♦ Vibthitt 



22 

ERJC 



Zspeciai gxijour 



AveAage. Vaily Attendance Ratu 



' ~J{ors dc 



oeavres 



4. Tut Rcaittfcs by Subgroup - 

♦ By ztluiicity 

♦ By 6QX 

♦ By dbaAbtioom 

♦ By school 
+ By gAadz 

♦ Von ApzQMiJL zducation Atudzntb 

♦ Fox Lwitzd-EnglUh pKO^tolznt (LEP) 6tudejitb 

5. CompcuuAon with A.e<J deuce gtioap* - 

♦ WiXh a national naming Aamplz 

♦ With thz Atatz 

♦ With othoA 6imiZa/i ctiAtrUctA 

♦ tdctfi AuAAoundLLng AubuAban dt&t/Uctb 

♦ W^cth thz (iUt/iMit in pnzviouA ijqjcuu 



^Desserts 



6. 5tig>u OjJ Succe44 - 



{ 



-X- fUgh school graduate* attending aotlzgz 
-X- National WonjLt SchoZcvalvip uilnneAA * 

• VinalutA j 
* ♦ Szholcuulitp izcipizntA 

■* StudzntA ^zoning at om abovz gnadz Izvzt 

•* StudzntA on thz ho^oi tiott 

-* StuAzntA not failing any oouasz6 

■* High school giaduatzb mzzting minimum aompztznaj 
MzqtMAzmzntA 

-* Students pKomotzd 

-* StudzntA mzzting o/i zxzzzding thzix pnzcUztzd 
ackizvmznt IzvelA 
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*Jp/fus Jes desserts 



* Students gaining one or mow years in a year 

* Gifted and talented studejits 

* Studeyits receivi>ig awarxU 



/ 



Entremets 




7. Heed* /u>t>eA6ment 

♦ Special education students 

♦ Students in biLinguat education 

♦ Student* in compensatory education 

♦ High school dropouts 

♦ Students patting at least one course 

♦ Students eligible ion. ^ree on. reduced-price meats 

♦ Students disciplined 

♦ Limited-Engtisk pro^tciient [LEP] students 

♦ Ui>xonXty students 

♦ Students scoring below gnade level 

♦ Students not meeting minimum competency requirements 
ion. graduation 

♦ Students not meeting theJji predicted achievement levels 

♦ Students not making a year' 6 gain in a year 

♦ Students not promoted 



Plic&s Vary by Sexuon and Serving Size 



* Menu design by Elaine E. Jackson* 
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